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I suspect that before I start, we should establish some ground 
rules or parameters for this discussion session. I know you could fill 
a library with periodical articles about the evaluation process. Terms 
like 'clinical supervision', 'J-BTE','duties based evaluation", and even 
'artisJc evaluation' have been seen in the literature. The ASCD even 
produced an excellent volume entitled "Teacher Evaluation: Six 
Prescriptions for Success". The plans outlined in that book are in use 
but, for the vast majority of us living in the real world they may not 
apply, indeed many of the contemporary theories on evaluation may 
not apply simply because of the situation we are in. 

I hypothesize that most of us are in school districts that use a 
rating sheet or a narrative format to evaluate teachers. Many 
districts require that the principal or assistant principals must do 
evaluation and some permit at least a part of the task to be 
delegated to department chairpersons. 

So, what J will address today is for the practitioner. The 
practionier who is working with a system that is currently in-place. 
The practitioner who wants to get the most out of the system and 
improve instruction 'n his or her building. If you are a member of 
the fortunate minority that has an elaborate system, stick around 
and when we get to discussion let us know what you are doing and 
how it is working. 
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What we should accomplish today 1 is devel^ ^ment of an 
understanding that any instrument can be used for the improvement 
of instruction and how to minimize anxiety while maximizing 
effectiveness in dealing with staff evaluation. 

Modem literature is full of reasons for evaluation. Most authors 
state two but some, such as Richard Mannat in "Teacher Performance 
Evaluation: A Total Systems Approach",has indicated six reasons. I 
tend to simplify matters and maintain that there is only one reason 
for evaluation^, that being to improve the delivery of instruction 
within our schools. Although, I do admit, that one way of improving 
is , at times, to remove an ineffective or incompetent teacher. None 
the less if effective schools research is correct and strong 
instructional leadership from the principal is a pre -requisite to a 
truly effective school, then the evaluation process is a good place to 
start. 

Much has been written about formative and summative 
evaluation so a word about each may be in order^ 

Formative evaluation deals with an ongoing process. It is non- 
judgmental. It could be coaching, mentoring, clinical supervision, or 
any other collaborative approach. It should not have documentation 
which winds up in a personnel file, though in some cases it may 
supply evidence on cooperativeness, etc. which becomes data for a 
final summative evaluation. 

A summative evaluation, on the other hand is judgmental and 
is responsible for providing the recommendation to continue or 
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discontinue employment, to grant or withhold increments, to reward 
or to punish. It is official, final, and is in the personnel file. 

Most experts agree that formative and summative evaluation 
should be done by different people. Such a procedure greatly reduces 
anxiety on the part of faculty members while tending to promote 
trust, at least between the formative evaluator and the evaluatee. 
Some of us may be able to use a department chair as a formative 
evaluator, others may not be so fortunate. 

In the real world, however, formative and summative 
evaluations are more intertwined then would be desired. Frequently 
the same person is responsible for both, and just as frequently every 
written observation report as well as an annual performance report 
winds up in a personnel folder. How, then, can we make such a 
system work to the best interest of everyone concerned. 

For ongoing evaluation and instructional improvement to work 
we must reduce anxietyl. Notice I said reduce, not eliminate; I have 
my reasons for that. First if we think we can eliminate anxiety when 
our observations and decisions effect a persons livelihood, we are 
wrong. Second if you do have a teacher that is not at all anxious 
about his or her evaluation either you don't do a very thorough job 
of evaluation, the district does not care ,the teacher is very confident, 
or has had a frontal lobotomy and nothing bothers him. 

A little anxiety is a good thing. It keeps people on their toes 
and provides a motivational force. Too much anxiety is a strong 
impediment not only to improvement in performance bat also to 
continuing the level of performance which currently exists. 

To reduce anxiety when you are formative and summative 
evaluator it is important to work hard from the start of the year to 
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establish a relationship which minimizes the summative aspect and 
accentuates the formative aspect of the evaluation process. Some 
steps could be: 

1) Have a pre-observation conference stressing that you want to 
helpJt may be necessary too, to simply state that you are not 
interested in making any faculty changes. Ask the teacher if 
there is any area he or she would like to work on. Remind them 
that you will be in more than once and that you want to 
demonstrate growth in one or two areas, not a metamorphosis 
of style. Assure the teacher that you are observing him and he 
should use the styles he feels comfortable with, even though 
you may suggest others. Judge teachers by how well they do 
with their styles, not by wether they use your style. 

2) When you go to visit the class do so unannounced but allow 
teachers to say 'please not today'-we are all entitled to a bad 
day and should not be observed then. Also let a teacher suggest 
a class to visit but do not make that the only class. 

3) Always find something positive to say, reenforce some good, 
solid technique, procedure or approach. Say you Mike it and 
why you\ like it both orally and in the wri :en document. We 
will talk about phraseology later. 

4) When you detect a problem don't just state the problem, say 
why and offer specific suggestions on how to solve the problem. 
Be flexible and bt willing to uiscuss-not just pontificate. 

5) Fairness is essential, be complete and professional but do not 
pick one minor point and make it the lynch-pin of a lynching. 
Remember we all have weakeners and we all have feelings. 
Kindness helps. 

6) Be consistent. What is good today for Mr. A is also good for Miss. 
B and for Mr. A the next time you see him. 



These six items will not eliminate anxiety but they should 
reduce it sufficiently so that it is not an impediment to perfonnance. 
From personal experience I can tell you that J am know as a tough 
evaluator and I have been successful in improving instruction, even 
removing teachers, without depressed faculty morale or 
unreasonable anxiety (examples-) except when I wanted anxiety. 

Lets take a look at some instruments and see how they can be 
used as diagnostic devices as well as evaluative tools. 

First, a rating scale that I picked up from an Illinois district 1. 
You can see that various items are to be rated from "Excellent" to 
Unsatisfactory". Since this page may be difficult to see, let me show 
you part of one area^ It is clear that the district is interested in 
goals and objectives. It is also clear that no definition or guidance is 
provided to the administration on what constitutes "excellent". One of 
the buildings in that district took the bull by the horns and exercised 
a management Franklinada and defined standards==or as Mel Heller 
always says "get off the dime and lead". The administrative staff of 
that school came up with the the evidence or data needed^. The two 
data sources were stated in writing and all staff members were 
informed of this at the start of the year. Still, what is "excellence?" 
Again, the administrative staff quantified what they were interested 
in^. (R.'.view standard). In a similar fashion definitions were 
provided for all levels of performance. 

The approach taken by that school went a long way to reduce 
anxiety and make evaluation more effective. Teachers knew what 
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was expected, what data administration would use, and what 
standards would be applied. The comment section of the form 
(return total form to screen) allowed administrators to use a 
narrative format to explain the reason for the rating— and a smart 
administrator would use more space and make suggestions. 

For example suppose objectives were stated such as "The 
students will know the capitals of the states".! The administrator 
may decide after discussion with the teacher that an overall rating of 
general goals and specific objectives was "Needs Improvement". A 
narrative could be (same overhead, next section). Now lets be 
prescriptive and try to improve instruction by expanding the 
narrative (same overhead, final section). We have effectively 
provided valuable assistance to the teacher and, in continuing to 
work with the teacher, helped. You see, it is possible to be narrative, 
if that is your style, even within a system that is essentially a rating 
scale. 

If we stop now, and go no further, we can not expect to see 
actual change in teacher behavior. It would be appropriate to make a 
recommendation. If there is no place for recommendations on your 
form, then include it in you comment section as shownlO (Review). 
Making the recommendation is still not sufficient and we must follow 
up with contacts or consultations, preferably without formal reports. 
This would provide some formative activity with less pressure and 
anxiety then would take place if each consultation resulted in a 
written report. 

A brief review^ First we notice a problem, we explained the 
problem and why it was a problem, we modeled an improved 
situation and made specific recommendations on remedial activity 
followed by hands on assistance and consultation prior to the next 
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formal observation or evaluation report. Now you have a chance, a 
real chance to effect teacher behavior chaige and improve the 
instructional program. 

About this time you are saying-Wait I don't have time for all of 
this. Sure you do, providing you limit yourself to one, two or at most 
three performance aspects of a teacher. You, or anyone can cause a 
teacher metamorphosis over night but you can accomplish the same 
end in smaller steps (Ben Franklin grape story). As an instructional 
leader you h^ve to do more then put a sign on your door saying you 
are the leader, you must act the part and take the time necessary to 
exert leadership. 

It could be you have too many teachers to evaluate, after all 
the industrial average is from 10-15 people per supervisor. OK, then 
pick and choose who you will work with and, for heavens sake, start 
with the workable, not the unworkable. Remember the old adage 

Do not start with the turkey's, you don't have enough time. If 
the turkey is non-tenured get rid of him, if tenured put him on the 
back burner until you have time to put him in the oven. You can do 
more to help your students by working with a dozen workable 
teachers who can and will improve then by concentrating on one or 
two 'vno will not or can not improve. 

To be certain, once some of the good guys are on their way to 
higher self- actualization and impicvement you can start selecting the 
really bad teachers (if you have any) and work intensively to build 
your case. Such people may never improve and it will take a good 
two year paper trail before you are able to try a dismissal on a 
tenured teacher, so bide your time, build your case and the turkey 
will eventually get into the oven and the heat will be turned on. By 
then you want to create anxiety-in the turkey but the rest of the 
faculty will know full well that he is deserving of being cooked and 
they will know too that you had helped them and are on their side. 
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Let me tell you a story of a new elementary school principal in 
southern Illinois who found a bad teacher. He knew the teacher was 
bad and so did others on the staff. The principal was encouraged to 
get rid of the teacher by other members of the faculty and so he 
wrote some poor evaluations and his superintendent was wiUing :o 
fight the brave fight. The teacher won. Why? Because the principal 
did not build a long enough train and make suggestions for 
improvement. The principal did not take the time necessary to prove 
his point. The principal depended on the support of other staff who 
testified against the principal because, as they said, 'it could be one 
of us next, he is bad but we must stick together'. The principal had 
not first established himseK as a person who truly wanted to help 
and he had not earned trust and respect. He depended on others. He 
lost. He is no longer a principal. 

Another story of an experienced principal new to a school. 
There was a bad teacher, but a nice guy. Everyone knew the teacher 
just did not have what it took. The principal did not make this 
teacher his first, second or third teacher to formally evaluate, he 
waited until word got around that he was tough but fair. Finally an 
observation was made and a 13 page narrative developed. The 
narrative pointed to problems such as not teaching the curriculum 
guide for the second year of the language because the teacher was 
still in the first year material; not using the target language in class 
except to define a new word, not controlling a class or managing 
time. The principal provided extensive and specific recommendations 
for all deficiencies. The principal offered to work with the teacher on 
a regular basis. The teacher felt anxious and a meeting was held with 
the building representative and a representative from the state 
association. The principal talked about how to help the teacher, the 
teacher talked about avoiding the pressure of observation. The 
principal would not relent on pressure but again said he would help. 
Eventually, a month later, the teacher said he would take early 
retirement but he could not live on his reduced pension. The 
principal demonstrated compassion and said, for a while, he would 
use the teacher as a substitute to help him financially. The teacher 
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retired and subed for one year. The students were better off, the 
teacher was, in the end, happy, and there was no faculty morale 
problem. Why no problem? Because help was genuinely offered but 
refused, because everyone knew the teacher was a viable 'target' and 
because compassion was forthcoming toward the teacher. 

We have seen that an insuument that is generally a check list 
can be used for an in-depth analysis of a teaching situation and as 
the basis for a prescription for improvement. Some districts have 
other forms. This comes from my New Jersey district^. Note that 
there are no guidelines and the evaluator is free to do as he or she 
would judge best. One suggestion would be to divide the commentary 
into four unequal parts as follows:^ 

Description 

A brief statement of what took place. No judgements, no detail. 
If this is more than 10 lines it is probably too much. 

Analysis of Strengths 

Almost all teachers have strengths. Tell them what they are 
and why you believe they are strengths. Dwell on it for a while, let 
the teacher know you appreciate that behavior, it is great positive 
reinforcement. Do not do as one New York superintendent told me 
"never say anything good". 

Analysis o f Growth Areas 

Notice I did not say 'weaknesses' or 'problem areas'. It goes 
down a lot easier when you talk in terms cf areas where growth is 
indicated, it is less threatening and causes less anxiety. 

^Overhead on Hamilton 
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In this section pick out some areas that need work. Identify 
them. Say why growth is needed and, when possible, model or 
explain the desired growth. I will give you some examples later. 

Summary and Recommendations 

Summarize the observation making certain to mention the 
positive as well as the negative. Then make very specific suggestions 
for growth, suggestions that are plausible and that you can monitor. 

To demonstrate this format let me show you parts of an 
observation report with the name changed. I will show the entire 
description section, one paragraph from strengths, one from growth, 
and the entire summary section ^ 

Now, these documents, comments ands recommendations may 
be part of a formative evaluation process. Lets look at a summative 
approach which still provides for prescriptive staff development. 

Wether you use a check list or narrative many states, such as 
New Jersey, require some form of professional improvement plan 
that the teacher will work on during the following year. Such plans 
are cooperatively determined and are very specific i;i nature a d 
carry with it an obligation on both the part of the administrator and 
the teacher. Some guidelines in developing plans would be as shown 
on the next transparency^ 

First review observation reports and select one or two areas for 
growth. Discuss them with the teacher and see if he or she has any. 
Mutually decide on no more than two items to work on, but be sure 
one of those items is one you identified. 
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Develop a very specific plan for staff development for that 
teacher. Provide the resources, timelines and any assistance that is 
needed. 

Explain how monitoring of that plan will take place ard what 
will be needed to meet the objective. 

In every observation the subsequent year make certain that 
the plan goals are kept in mind but do not limit work on the plan to 
formal observations, be available to provide assistance. 

As an example, let me show you a copy of a plan that I have 
been using this year with two teachers who needed to demonstrate 
growth in the area of preparing teacher tests^ 

I hope I have been able to show that evaluation is a natural 
feed for development. Evaluation is also diagnosis and from that can 
come prescription. It makes no difference if the instruments used are 
check list or narrative, from every observation comes data for 
diagnosis and prescription as well as evaluation. Remember that just 
as a doctor who evaluates your case but fails to give you a diagnosis 
and a curative prescription has not done his or her job, so too the 
administrator who evaluates without diagnosing and prescribing has 
not done his job.2 
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Dear Colleague; 



Thank you for attending my discussion session on Staff Evaluation: Strategies fn r 
Continuous Instructionai improvement, i realize there are many distractions in this fine city 
and many other programs you could attend. hope you found the session of some value, or at 
least interesting. 

This packet of material contains all of the overhead transparencies which I used as well 
as a copy of a follow-up memo on the Professional Improvement Plan outlined in the 
presentation. I hope this material is helpful to you. If you purchase the audio tape of this session 
this booklet can re-create the discussion session for you, or others in your district. 

Please feel free to use this material in your home school or district, I only ask that you 
credit the source. We are, after all, working toward the same goal of improving instruction. 

Finally, please feel free to call me if you have any questions. While at the convention I 
am at the Hilton and after the convention you can reach me at school between 7:30AM and 
3:30PM. If you call me at Nottingham and I am not there, set an appointment time for you to call 
back and my secretary will make certain I am available. 



Very tmly yours. 




William A. Rieck, Ed.D. 

Principal 
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OBJECTIVES 



1 ) That evaluation instruments can be used 
for continuous instructional improve- 
ment by creating a methoc for develop- 
ing prescriptive improvement plans. 



2) That good evaluation can take place 
and anxiety can be reduced through the 
use of good technique. 



PURPOSE 



The only valid reason to evaluate staff is to 
improvfethe instructional process 

though that may, at times, mean the re- 
moval of a teacher. 



EVALUATION TYPES 



Formative: Ongoing, no judgements,no 

decissions. 

Summative: Judgemental, decission 

making 



In the real world evaluation is usually both 
formative and summative, frequently with 
the same administrator performing both 
tasks. 




An abnormal and overwhelming sense of 
apprehension and fear often marked by 
physiological signs, by doubt concerning 
the reality and nature of the threat, and by 
self-doubt about one's capacity to cope 
with it. (Webster's New Collegiate) 



1 ) Pre-Observation Conference -Try to set 
teacher at ease-tell them you hope to 
help and are not interested in changing 
staff. 

2) Teacher Freedom to say 'not today' 

3) Positive Feedback - always find some- 
thing good to say and write. 



4) Give Reasons as to why something is 
good, or not good 

5) Fairness is essential, don't dweli on a 
minor neg&tive and forget the positive. 

6) Be Consistent - What is good for the 
goose is good for the gander, today and 
everyday. 




MJSTRUMKIir FOR EVALUAIIOW OV TEACHER PERFoRMiiNCli 

(when a grado of unsatisfactory or needs improve- 
ment fs given » the comment block must be completed) 



1. Cstablinlies learning objectives consistent 
with appraisal of student needs as follows: 

a. Establishes general goals and specific 
ob jcct ives 

b. Uses teaching techninues fitting the 
situation 

c. Provides a physical environment suit- 
able to the teaching situation--that 
iSf bulletin boards, lighting, arrange* 
ment of furniture 



d. Planning - lesson plans 

2, Plans for and uses instrucFional me tlioJs 
and resources wliich motivate each stuuerft 
to achieve learning objectives as follows: 



a. Demonstrates knowledge of subject 
matter 



b. tiakes effective use of resources 
available 



c. Usi^s teaching techniques approprlntc 
to the learning objectives 

d. Utilizes such human*relations tech- 
nic)ues ns acceptance, praise, hiunor 
wl;en warranted 



3, Plana for and utilizes eval\iation tech 
nin\ios which motivate and enable each 
student to achieve learning objecflvos 
as follows: 




Maintains appropriate level of 
class control 
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. Establishes learning objectives consis- 
tent with appraisal of student needs as 
follows: 

a) Establishes general goals and 
specific objectives. 



1a. Establishes general goals and s p e - 
cific objectives 

Evidence or Data 

1. Examination of written goals and 
objectives as supplied by the teacher. 

2. Discussion between administrator 
and teacher on goals or objectives and 
their educational rationale. 



Excellent 



1 . The teacher can provide, upon request, 
goals and objectives for all lessons or 
units. 

2. Objectives are all behaviorally stated 
and are well written demonstrating what 
performance is expected of the stu- 
dents. 

3. The teacher can discuss goals and ob- 
jectives with the administrator and 
provide an educational rationale for the 
objectives. 

4. All goals and objectives demonstrate 
adherence to board policy and admin- 
istrative procedure. 



"The students will know the capitals of 
the states". 



The objective jacl<ecl specificity 
with respect to student outcomes. The 
term "l<now" means different things to 
different peopie and is not sufficient. In 
our post observation conference Mr. 
Smith indicated he expected students to 
be able to place and name the capitals 
on a blank outline map. 



An Improved objective could be "The 
students will be able to complete and 
outline map correctly naming and locat- 
ing all state capitals" This objective 
more accurately reflects student out- 
comes. 



Based upon this observation I would 
recommend that Mr. Sm'th take care to 
be certain that all objectives are written 
in terms of what students are expected 
to learn. To assist with this Mr. Smith 
may, at his option, follow one or more of 
the specifics below. I will examine Mr. 
Smith's plan bool< at the start of each 
week for the purpose of providing infor- 
mal feed-back on objectives until the 
next formal observation report. 

a) Review Bloom's Taxonomy or some 
of Maeger's work on objectives 

b) Discuss with me your planned objec- 
tives prior to writing the weeks less- 
on plans 



1. Observe a problem 

2. In the formal report 

a) Identify the problem 

b) Explain why it is a problem 

c) Model an alternative 

d) Recommend remediation 

3. Offer and provide assistance, infor- 
mally if possible (keep notes) 

4. Re-observe formally to show growth. 

Improves Instruction 
Reduces Anxiety 
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Description 

1) Brief 

2) Factual, non judgmental 

Analysis of Strengths 

1) Say what is good 

2) Say why it is good 

3) Give praise 

Analysis of Growth Areas 

1) Identify the area for growth 

2) Say why growth is needed 

3) Model the growth or give examples 

Summary and Recommendations 

1) Summarize everything 

2) Make recommendations specific 

3) Make recommendations meaningful 

4) Make recommendations measurable 

5) Let the teacher make a professional 
decision on what to do. 



Descriotion 



This ninth grade Physicai Science ciass 
started on time with ail students prepared 
to worlc. IWs. Jones used a lecture-discus- 
sion approach to teaching a iesson on 
atomic structure. The class continued to 
the end of the period when an assignment 
was given. 

As part of this observation IVIs. Jones' 
grade book and plan bool< were reviewed. 
Both documents were up to date and the 
plan bool< reflected board approved cur- 
riculum. 
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Analysis of Strengths 



Ms. Jones made excellent use of the 
overhead projector. For example, In dis- 
cussing atomic structure diagrams were 
placed on the projector using different 
colors to represent electrons, protons and 
neutrons. Students were asked to supply 
the appropriate Information. This tech- 
nique provided for both the auditory and 
visual learner while tne overhead allowed 
Ms. Jones to remain in a position where 
she could see the class and they could see 
what was written. The use of color was a 
discrimination aide. Finally, by facing the 
class Ms. Jones was assured that all stu- 
dents could hear what she had to say. 



Analysis of Growth Areas 

While Ms. Jones asked questions dur- 
ing the classjthere is room for growth in 
this area. For example, Ms. Jones said 
"John, how many protons are there in 
oxygen?" whereupon an unidentified stu- 
dent said "8". Ms. Jones followed with 
"Melissa how many electrons?" Melissa 
responded "8". These and similar ques- 
tions were all on the lower levels of cogni- 
tion and never was a specific student iden- 
tified to respond to the question. 

A district goal is to foster the develop- 
ment of higher order thinking skills. There 
were opportunities to work toward this 
goal which were missed. For example, 
why not consider asking "Why did you say 
8 protons? What gave you the clue?" A 
question such as this would cause a stu- 
dent to reflect on the relationship between 

<- -^ 
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1) Try to infuse more higher ievei ques- 
tions. Questions such as "Why?" or 
"What relationship do you see?" You 
may want to consider consulting re- 
sources such as Bloom's Taxonomy or 
Ornstein's excellent articles on ques- 
tioning. I have copies of these and would 
be pleased to loan them to you. Or you 
may, at your option, set up an appoint- 
ment with me to discuss higher level 
questioning. 

2) Consider Identifying a question respon- 
dent after the question has been asked 
and waiting 3-5 seconds before going 
to another student. 



SUMMATIVE PRESCRIPTION 



1) Review observation reports 

2) Select, for consideration, one or two growth 
areas and have the teacher do the same. 

3) Develop a specific plan for one or two 
goals. 

a) Goal 

b) How will the goal be reached 

c) Time frame 

d) Help which will be provided 

e) How will attainment be judged 

4) Monitoring 



the number of protons and the atomic 

number of an atom rather than, perhaps, 
reading the information from a table in 
the book. 



Summary and Recommendations 

This class was wall organized and struc- 
tured. Students were attentive and the use 
of the overhead projector and color cod- 
ing of sub-atomic particles enhanced the 
overall delivery of the plan. The lesson 
reflected board approved curriculum and 
the plan book was complete containing 
excellent objectives and lesson design. 
There are two recommendations for re- 
finement of technique which could Im- 
prove this and other classes: 



5) The test will be designed so as any 
student properly placed in practical 
chemistry should be able to satisfacto- 
rily complete the test. Therefore, it is 
expected that most students should 
pass the test unless the grade book 
indicates failure to do homework as- 
signments and/or there is indication 
that a student is improperly placed. 
This is not to be construed as an as- 
sumption that all students will pass 
since that would not be realistic. How- 
ever a goal would be a pass rate of 90% 
or more. 



Assistance Required 



1) The principal will serve as a consultant 
in test construction. The first unit test 
of the year in chemistry will be reviewed 
by the principal prior to administration. 

2) At Mr. Smith's discretion the principal 
will consult in the design of any or all 
unit tests prior to their construction. 
Should the principal be consulted he 
will, for the first test, go through all of 
the procedures with Mr. Smith as enu- 
merated in this plan. 

3) Mr. Smith is free to utilize the services 
of Dr. Jones, science supervisor, should 
he desire to do so. 



Professional Improvement Plan 



Objective 

To develop unit tests in practical chem 
istry whicli reflect student learning objec 
tives and good testing practice. 



Plan of Action 

1) In constructing each unit test Mr. Smithi 
will stLa with the list of objectives cov- 
ered in the unit and will determine the 
relative importance of each. 



2) In desiii' ing each unit test once the 
number of objectives and relative Im- 
portance of objectives has been de- 
termined Mr. Smith will design test 
Items to test each objective and/or 
multiple objectives showing their In- 
ter-relationships. 

3) Once Items are constructed the test 
will be designed so as to reflect the 
relative importance of objectives. 

4) All tests that are constructed will con- 
tain nc true/false Items nor any multiple 
choice Items with fewer than four rea- 
sonable choices. Completions will 
account for not more than 10% of the 
test. Each test will contain problems 
and/or free response Items which re- 
quire learning above the level of com- 
prehension. 



Time Frame 



This Professional Improvement Plan 
starts with the first test of the 1988-89 
school year and continues throughout 
the year. Each test will be presented to 
the principal at least two days prior to 
it's administration. The principal will re- 
view the test and confer with Mr. Smith. 



4^ 



Evaluation 



This professionai improvement plan 
shall be considered satisfactorily com- 
pleted If Mr. Smith adheres to the submis- 
sion of tests and if those tests untimately 
are approved for use. It is understood that 
there may be a time when the principal no 
longer considers regular submission 
necessary. It is also understood that stu- 
dent performance on the tests will not be 
a factor in determining the success of this 
plan. 



PRE CONFERENCE ;:! 
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Establish Expectations 




OBSERVATION 




Formative Evaluation Data 
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NOTTINGHAM HIGH SCHOOL 
Dr. William A. Rieck, Principal 



To: 

From: Dr. Rieck 

Date: October 15, 1988 

Subject: Unit Test Analysis 



Thankyouvery much for providing me with acopy of yourfirstunittest in accordance 
with your PIP for the 1988-89 school year. I have analyzed the test and compared the test items 
to the objectives in your plan book. What follows is a result of that analysis and comparison. 

ANALYSIS OF TEST ITgli^S 

I found all of the test items to be reasonable and in accordance with objectives found 
in your plan book. There are, however, two items on which I will make specific comment. 

(1 ) In item #1 6 to add "(To answer fill in more than 1 letter)." This tells the students that there 
is more than one letter for the answer. It would be better to include directions such as: "More than 
one letter may be used, if needed." This more general direction does not provide the clue that your 
phrase does, yet, it still informs students that more than one letter is possible. 

(2) In item #35 two choices may cause difficulties. Specifically, the terms "theory" and "model" 
are sometimes used interchangeably in science. In the event that a clear distinction was made 
betw»3en the two terms, then my concern would be justified. Often, however, scientists use 
modeling as a method for expressing a theory. 

ITEM-OBJECTI VE AGREEMENT 

While all test items were covered by objectives, not all instructional objectives v/ere 
tested. Below are listed the objectives not tested and sample test items that could be used to test 
those objectives. It is understood that my sample items are not the only way to test the various 
objectives. 

(1 ) "Students will describe the correct way to ?an experiment' I could not make uut the word 
where the "?" appears, but the content section of the plan book develops the various parts of the 
scientific method, omitting the gathering of background information. Three sample test items will 
be provided at three levels of cognitive complaxity. 

(a) List, in sequence, the steps followed in the scientific method or 
experimental procedure. 

(b) Describe each step in the scientific method (or experimental 
procedure.) 



(c) Select a problem from your everyday life and write a brief essay 
explaining how you could use the scientific method (or experimental 
procedure) to solve that problem. Be sure to include each step that 
we discussed in class. 

(2) "Students will be able to define chemistry, matter, and practical 
chemistry." The items below are all on low-cognitive levels, except for the 
final item which requires higher order-thinking skills. 

(a) Define the terms chemistry, .-natter, and practical chemistry. 

(b) Matter is anything that has and takes up space. 

(c) Chemistry can best be defined as: 



(d) Construct a short essay in which you distinguish between chemistryand practical 
chemistry. Be sure to include the definition of each , as well as an explanation of the difference. 

(3) "Students will be able to give the rule for writing symbols." Two forms of test Items are 
provided— each of which is a low-level question in terms of cognition. 

(a) List the rules for writing chemical symbols. 

(b) Which of the following is not a rule for writing chemical symbols? 



(A) Use a capital for the first letter. 

(B) Use two letters only when there is another element with the same first letter. 

(C) Always use Latin names for elements. 

(D) Never capitalize the second letter of a symbol. 



(4) "The students will review elements and their Latin origins. " The term "review" is not stated 
in terms of student goals, but rather a process. Assuming that students are expected to be able 
to understand and write the Latin and English names, I have framed two forms of test items. 

(a) The Latin terms Ferric, Ferrous and Ferrum referto the element we call . 



(b) The Latin terms "cupric" and "cuprous" refer to the element we call 



(A) 
(B) 
(C) 
(D) 



study of matter and changes that occur in matter 
study of the physical nature of matter 
study of compositions used in households 
study of atoms 



(A) cobalt 

(B) copper 

(C) cesium 
(0) calcium 



(5) 'The students will be able to list three differences between a model and an atom. " It is 
evident that the quicl<est way to frame a question would be to construct an item as below, but others 
are also available. 

(a) List three differences between a model and an atom. 

(b) Explain how an actual atom differs ^rom the model we studied. 

(c) Which of the following is a difference between an atomic model and an actual atom? 

(A) The model does not contain the correct number of neutrons. 

(B) The model does not correctly show electron paths. 

(C) The model does not show correct number of electrons. 

(D) The model does not show placement of protons. 

Time does not permit me to construct items for all objectives that were not covered 
on the test. Please look at Objective 2 for day 5, Objective 2 for day 9, Objective 2 for day 1 1 and 
Objectives 1 and 2 for day 12 for other areas not directly covered on the test. Feel free to disr :ss 
this with me and discussion takes somewhat less time than this form of analysis. 

TEST DESIGN 

It is certainly acceptable to utilize a totally multiple-choice test, but I would prefer it 
if you would consider using a variety of test items which would reduce the boredom factor and 
provide students with items that may be more to their liking (differen' students have different 
preferences). Consideration should also be given to at least one item that requires the students 
to write an answer in complete paragraph form which would help in the development of their writing 
skills, as we!l as their thought process. 



ERIC 
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